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(54) Synchronized presentation of teievlsion programming and internet content 



(57) Uniform Resource Locators (URLs) or other 
network information identifiers are transmitted with tel- 
evision signals in order to permit web content to be dis- 
played in synchronization with television programming. 
In an illustrative embodiment, URLs are embedded in a 
closed caption portion of a transmitted television signal, 
and delimited from the closed caption text using prede- 
termined delimiting characters. A decoder extracts the 
URLs from the television signal, and supplies the URLs 
to a retrieval device which automatically retrieves cor- 



responding web pages or other similar information over 
a network. The retrieved web pages are then displayed 
to a viewer in synchronization with related programming 
in the television signal. The retrieval device may be a 
set-top box associated with a television set that displays 
both a retrieved web page and the corresponding tele- 
vision picture portion of the television signal. Alterna- 
tively, the retrieval device may be a computer which re- 
trieves and displays a web page, while the correspond- 
ing television picture is displayed on a television set. 
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Description 

Field ot the Invention 

[0001] The present invention relates generally to 
techniques for integrating television and compuler sys- 
tems, and nwre particularly to techniques for presenting 
World Wide Web content or other connputer network in- 
formation to viewers in conjunction with television pro- 
gramming. 

Background of the Invention 

[0002] it is not uncommon for television programming 
transmitted to viewers to include Internet web address- 
es or other information that the viewers can use to ac- 
cess additional information related to the programming. 
For example, television advertisements often include 
Uniform Resource Locators (URLs) which identify the 
web site of the advertising company. Similarly, television 
news programs and televised events often display URLs 
which 'identify web sites corresponding to the respective 
programs and events. Under current practice, a viewer 
desiring to access a URL displayed in a television pro- 
gram must either write down the URL or attempt to re- 
member it. The viewer then must enter the URL in a 
browser program on their personal computer in order to 
access the corresponding web site. This can be incon- 
venient and frustrating for the viewer. 
[0003] Although systems have been developed re- 
cently which allow viewers to access web sites from a 
television using a television set-top box, such systems 
typically operate in a manner similar to web browsers 
on personal computers. As a result, such systems are 
generally unable to extract a URL from a televised pro- 
gram such that the viewer need not reenter it to access 
the corresponding web site. Furthemnore, such systems 
are unable to present web content to a viewer in syn- 
chronization with television programming which in- 
cludes the corresponding URLs. For example, even a 
viewer which has a computer and a television in close 
proximity must continually enter the televised URLs in 
order to view a sequence of web content related to the 
television programming. 

Summary of the Invention 

[0004] The invention utilizes URLs or other network 
information identifiers transmitted with television signals 
in order to permit web content to be displayed in syn- 
chronization with related television programming. In an 
illustrative emibodiment. URLs are embedded in a 
closed caption portion of a transmitted television signal, 
and delimited from the closed caption text using prede- 
termined delimiting characters. A decoder extracts the 
URLs from the television signal, and supplies the URLs 
to a retrieval device which automatically retrieves cor- 
responding web pages or other similar information over 



a network. The picture portion of the television signal is 
supplied to a conventional television set, and the re- 
trieved web pages are displayed to a viewer in synchro- 
nization with the television programming. A viewer 
5 therefore no longer needs to manually enter televised 
URLs into a web browser or similar network access pro- 
gram. Instead, web content corresponding to the em- 
bedded URLs is automatically retrieved and displayed 
to the viewer as the television programming progresses. 
10 For example, as the television programming moves 
from one advertisement or program to another, the em- 
bedded URL will change, such that a new web site is 
accessed and the corresponding web page displayed to 
the viewer when the new advertisement or program is 
15 displayed on the television set. If a given displayed web 
page is of particular interest to a viewer, the viewer can 
select that web page for continuous display, in which 
case the synchronized presentation of web content is 
disabled until the viewer elects to resume it. 
20 [0005] In one embodiment of the invention, the re- 
trieval device may be a set-top box associated with the 
television set, such that the television set displays both 
a retrieved web page and the television picture portion 
of the television signal. The set-top box, which may in- 
25 elude the above-noted decoder establishes a connec- 
tion over the network with a sen/er that delivers a web 
page for display on the television set with the picture 
portion of the television signal. The retrieved web page 
may be displayed on the television set simultaneously 
30 with the picture portion of the television signal, using a 
picture-in-picture (PIP) type arrangement, or a viewer 
may be permitted to select between display of a re- 
trieved web page and display of the picture portion of 
the television signal. In another embodiment of the in- 
35 vention, the retrieval device may be a computer which 
retrieves and displays a web page specified by an em- 
bedded URL, while the corresponding picture portion of 
the television signal is displayed on the television set. 
In yet another embodiment of the invention, the retrieval 
40 device may be a television tuner card within a computer. 
A television picture generated by the tuner card is then- 
displayed in one window on the computer monitor, while 
a web page specified by a URL embedded in the tele- 
vision signal is displayed in another window on the mon- 
45 itor. 

Brief Description of the Drawings 
[0006] 

so 

FIG. 1 illustrates an exemplary embodiment of the 
invention in which a closed caption decoder is used 
to extract a Uniform Resource Locator (URL) or oth- 
er network Information identifier transmitted in a 
S3 closed caption portion of a television signal; 

FIG. 2 is a flow diagram illustrating a URL detection 
and display process in accordance with the inven- 
tion: 
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FIG. 3 illustrates an embodiment of the invention in 
which a set-top box is used to display web content 
on a television display based on a URL or other net- 
work information identifier extracted from a televi- 
sion signal; and 

FIG. 4 illustrates an embodiment of the invention in 
which a computer is used to display web content 
based on a URL or other network information Iden- 
tifier extracted from a television signal. 

Detailed Description of the Invention 

[0007] The invention will be described below in con- 
junction with a number of illustrative embodiments for 
displaying web content in conjunction with related tele- 
vision programming. The invention is not limited to use 
in these embodiments, but is instead more generally ap- 
plicable to any system in which it is desirable to transmit, 
in conjunction with television programming, Unilorm Re- 
source Locators (URLs) or other identifiers which spec- 
ify web sites or other sources of computer network in- 
formation. The term "network information identifier" as 
used herein should be understood to include URLs as 
well as any other type of network information identifier. 
The term "web" as used herein is intended to include 
not only the World Wide Web portion of the Internet, but 
also other portions of the Internet as well as other types 
of computer networks including intranets and extranets. 
The term "web site' should be understood to include any 
source of information which can be specified by a URL 
or other type of network information Identifier. The term 
"television signal" as used herein is intended to include 
analog video signals in accordance with NTSC, PAL or 
other standard formats, digital video signals including 
MPEG-encoded signals, high definition television 
(HDTV) signals, and any other typo of image signal 
which may be supplied to a receiver via broadcast air- 
waves, cable network, satellite network, computer net- 
work or any other type of signal distribution mechanism. 
The term "automatically" as used herein in conjunction 
with retrieval of information over a network includes the 
retrieval of such information without the need for further 
intervention from a viewer. 

[0008] FIG. 1 shows a system 10 for implementing 
presentation of web content in conjunction with related 
television programming in accordance with the inven- 
tion. The system 10 includes a closed caption decoder 
12 and a television 1^ A television signal transmitted 
from a broadcast transmitter includes a video or "pic- 
ture" portion, a closed caption text stream, and one or 
more URLs. The URLs are transmitted so as to coincide 
with the television programming represented by the pic- 
ture portion of the signal. For example, when the pro- 
gramming corresponds to an advertisement, the corre- 
sponding transmined URL may identify a web site of the 
company or product being advertised. Similarly, news 
programming may be transmitted with URLs identifying 
one or more web sites which describe various news 



items in greater detail, and music video programming 
may be transmitted with URLs identifying web sites of 
the recording company, artist or studio associated with 
the music video. Numerous other relationships between 

5 the transmitted programming and URLs are of course 
possible. The television signal may bo received in the 
system 10 in a conventional manner via an antenna, ca- 
ble network, satellite receiver or other type of conven- 
tional signal reception device; and is applied to an input 

10 of the closed caption decoder 12 as shown. 

[0009] The URLs may be transmitted as strings em- 
bedded in the closed caption text stream of the televi- 
sion signal. A given URL string transmitted in this man- 
ner may be delimited by a known character, or set of 

15 characters, that appears in the closed caption text 
stream before and after the URL string. For example, 
brackets or quotes may be used as delimiting characters 
for a URL string. The decoder 12 includes appropriate 
hardware or software logic (unclions for extracting URLs 

20 from the closed caption stream. In the exemplary sys- 
tem 10 of FIG. 1, the picture and closed caption text 
stream are supplied to the television 14 and displayed 
on the display 1 6 in a conventional manner. It should be 
noted that an extracted URL may also be supplied from 

2S the decoder 12 to the television 14. such that it is dis- 
played to a viewer along with the programming to which 
It corresponds. Such a display of the URL on the televi- 
sion 14 will generally be in an area of the display 16 
separate from that used for the closed caption text. It 

30 should also be emphasized that although the FIG. 1 em- 
bodiment illustrates the invention in conjunction with the 
use of closed caption text, the invention does not require 
the use of closed caption text. 

[0010] The extracted URLs from the decoder 12 are 

3S applied as inputs to a web browser program 1 7. The v/eb 
browser program 17 uses a given extracted URL to es- 
tablish a connection over a network for accessing the 
web site Identified by the extracted URL A web page 
1 8 associated with the web site identified by the extract- 

40 ed URL is then displayed by the web browser 1 7. As will 
be described In greater detail In conjunction with FIGS. 
3 and 4 below, the web browser 1 7 may be implemented 
using a set-top box connected lo the television 1 4, such 
that web page 18 is displayed in a portion of the televi- 

45 sion display 16, or may be Implemented using a com- 
puter with an Internet connection or other suitable net- 
work connection, such ihat the web page 18 is displayed 
on a display screen of the computer. The web pages 
associated with the URLs extracted from the television 

50 signal may be displayed in synchronization with the cor- 
responding television programming, such that the dis- 
played web page changes each time a different URL is 
extracted from the closed caption text stream by decod- 
er 12. As noted previously, the embodiment of FIG. 1 

ss does not require the use of a closed caption decoder. 
Alternative embodimenls may use any oiher type of de- 
coder which is capable of extracting a URL from a trans- 
mitted lelc ision signal. 



3 



EP 0 915 621 A2 



6 



[001 1] FIG. 2 is a flow diagram illustrating the opera- 
lion of the system 10 of FIG. 1 in greater detail. Step 20 
indicates that URLs are broadcast as strings embedded 
in a closed caption text stream associated with a televi- 
sion program. In step 22, the closed caption decoder 1 2 
of FIG. 1 extracts a current URL from a television signal 
applied thereto. The current URL refers generally to the 
latest URL received by the decoder 12. In step 24, a 
determination is made as to whether or not the current 
URL extracted in step 22 corresponds to a "blank" URL. 
A blank URL in accordance with the invention is a spec- 
ified U RL or other suitable code which indicates that the 
associated URL will not be displayed or used to access 
a web site. When a blank URL is received, step 25 indi- 
cates that the URL-based part of the display, for exam- 
ple, the web page 1 3 displayed by the web browser pro- 
gram 17, is cleared, and the FIG. 2 process then waits 
until the next URL is received. As noted previously, the 
URL itself may also be displayed along with the televi- 
sion picture on display 16 of television 14. In such an 
implementation, clearing the URL-based part of the dis- 
play will also clear the URL from the television display. 
Upon receipt of the next URL. the process will return to 
step 22 to extract that URL as the current URL 
[001 2] If the URL extracted in step 22 is not a blank 
URL. that URL is used to access a web page which Is 
displayed in step 26. The web page corresponding to 
the current URL may be displayed continuously until the 
next URL is received in the decoder 12. In step 27, a 
determination is made as to whether the next URL has 
been received. If the next URL has not yet been re- 
ceived, the display based on the previously-extracted 
URL continues in step 26 until the next URL is received. 
If the next URL has been received, a determination is 
made in step 23 as to whether the viewer has selected 
the current URL displayed in step 26 for continued dis- 
play. The viewer may select this continued display mode 
for a given displayed URL if that URL is of particular in- 
terest to the viewer. This allows the viewer to turn off the 
ongoing display of transmitted URLs in order to focus 
on the URL of particular interest. 
[001 3] If the viewer has selected the current displayed 
URL for continued display, step 29 indicates that this se- 
lected URL, as well as its associated web content, is 
displayed to the viewer until the viewer elects to resume 
display of additional URLs in synchronization with the 
displayed television programming. If it is determined in 
step 28 that the viewer has net selected the current URL 
displayed in step 26 for continued display, the process 
returns to step 22. The decoder 12 then extracts the next 
URL from the closed caption text stream this extracted 
URL becomes the current URL, and the displayed web 
content is updated in accordance with steps 24. 25 and 
26. A viewer is thus able to view web content related lo 
television programming on the television 1 4 without ever 
having to enter a URL into a web browser program. As 
the television programming progresses, the transmitted 
URLs change, and the displayed web content also 



changes accordingly, wilhoul any input required from 
the viewer. As previously noted, a viewer can elect lo 
continue the display of any transmitted URL and its cor- 
responding web content if that URL is of particular inter- 
5 est to the viewer. 

[0014] FIGS. 3 and 4 illustrate two exemplary imple- 
mentations of a system such as that described in con- 
junction with FIGS. 1 and 2. FIG. 3 shows a system 30 
in which a broadcast transmitter 32 embeds URLs in tel- 
10 evision signals transmitted to viewers. As noted above, 
such a te levision signal may be received via an antenna, 
a cable network, a satellite receiver or other suitable re- 
ceiving equipment. The set-top box 34 receives the tel- 
evision signal and the URLs embedded therein, and uti- 
is lizes an internal decoder to extract the embedded U RLs. 
This internal decoder may. but need not, be a closed 
caption decoder such as decoder 12. Any decoder suit- 
able for detecting a transmitted URL or other transmitted 
network information identifier may be used. The set-top 
20 box 34 in this embodiment includes an internal tele- 
phone line modem, a cable modem or other similar de- 
vice suitable for establishing a network connection with 
a network 40. The network 40 may be, for example, the 
Internet or any other computer, cable or satellite network 
25 as well as various portions or combinations thereof. The 
set-top box 34 may also implement a web browser pro- 
gram or other suitable network access software. The 
set-top box 34 uses the web browser program and the 
internal modem to establish a connection via network 
30 40 to a server 42 corresponding to a given extracted 
URL. The server 42 then delivers a web page specified 
by the extracted URL to the set-top box 34 over the net- 
work 40. 

[0015] The set-top box 34 delivers the picture portion 
35 of the television signal to a television 36. for display in 
a main area of the television display 33. The set-top box 
34 also delivers the extracted URL. and the correspond- 
ing web page retrieved from server 42, to the television 
36. In this embodiment, the television display 38 in- 
40 dudes a picture-in-picturc (PIP) area 44 which is used 
to display the retrieved web page simultaneously with- 
the picture portion. The set-top box 34 or television 36 
may also be configured to allow a viewer lo switch be- 
tween a variety of different types of displays, such as a 
4S display of only the picture portion, a display of only the 
web page, or a display in which the picture portion is in 
the PIP area 44 and the retrieved web page is in a main 
area of the display. Numerous other lypes of displays 
are also possible. The web browser software imple- 
50 mented by set-top box 34 may be configured to allow a 
viewer to visit a variety of web sites other than that cor- 
responding to the current URL. For example, the set-top 
box 34 may be configured to store a list of recently-ex- 
tracted URLs, such that a viewer can select display of 
55 a given web page from either the current URL or from 
some other recently-extracted URL. Viewer commands 
and other control information may be entered in a con- 
ventional manner using a remote control, keyboard. 
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mouse or similar input device, 

[0016] FIG. 4 shows a system 50 in which URLs are 
embedded in a television signal transmitted from broad- 
cast transmitter 32 as previously described. A decoder 
52 receives the television signal, extracts an embedded s 
tJRL, and delivers it over a serial connection or other 
suitable connection to a computer 54. The computer 54 
runs a web browser program which uses the extracted 
URL from the decoder 52 to establish a connectbn with 
sender 42 over network 40 in a manner similar to that 
described in conjunction with FIG. 3. The sen/er 42 de- 2. 
livers a web page specified by the extracted URL to the 
computer 54, and the web page is displayed on a display 
56 of the computer 54. The decoder 52 supplies the pic- 
ture portion of the television signal along with the ex- ^5 3. 
traded URL to the television 36. The television display 
36 displays the picture portion of the television signal as 
well as the extracted URL. A viewer using system 50 
can thus view programming on the television 36 while 
simultaneously viewing related web content on the com- 20 4. 
puter 54. As in the previous embodiments, the displayed 
web content changes in synchronization with the URLs 
transmitted in the television signal. 

[0017] Alternative embodiments of the invention may 5. 
utilize different mechanisms for delivering URLs or other 25 
network information identifiers In conjunction with relat- 
ed television programming. For example, although the 
illustrative embodiment of FIGS. 1 and 2 use URLs em- 
bedded in a closed caption text stream, other embodi- 
ments of the invention could incorporate the URLs into 30 6. 
another portion of a transmitted television signal, such 
as onto a subcarrier or other signal associated with the 
television signal. It is also possible to transmit the URLs 
on another signal which is only roughly synchronized 
with the television signal. The URLs therefore need not 55 
be embedded in the transmitted television signal itself. 
Moreover, the URLs could be encoded or otherwise 
processed in any suitable manner prior to transmission 7. 
rather than transmitted in a manner similar to that used 
to transmit closed-caption text. Furthermore, a variety 
o( configurations other than those described in FIGS. 1 
through 4 may be used for extracting URLs and display- 
ing corresponding web content in accordance with the 
invention. For example, the invention may be imple- 8, 
mented using a computer which includes a television ^5 
tuner card, such that the television picture generated by 
the tuner card is displayed in one window on the com- 
puter monitor, while a web page specified by a URL em- 
bedded in the television signal is displayed in another 9. 
window of the monitor. These and numerous other al- ■SO 
ternative embodiments within the scope of the following 
claims will be apparent to those skilled in the art. 



receiving al least one network information iden- 
tifier transmitted with a television signal; and 
supplying the network information identifier to 
a device which utilizes the network information 
identifier to automatically retrieve Information 
over the network, such that the retrieved infor- 
mation Is displayed to a viewer in conjunction 
with related programming in the television sig- 
nal. 

The method of claim 1 wherein the network infor- 
mation identifier is a Uniform Resource Locator 
(URL) identifying a web site. 

The method of claim 1 or claim 2 wherein the re- 
ceiving step includes receiving the network informa- 
tion identifier in a closed caption portion of the tel- 
evision signal. 

The method of claim 3 further including the step of 
decoding the closed caption portion of the television 
signal to recover the network information identifier. 

The method of claim 3 wherein the network infor- 
mation identifier is embedded in a text stream of the 
closed caption portion of the television signal and 
delimited by one or more predetermined charac- 
ters. 

The method of any of the preceding claims wherein 
the step of supplying the network information iden- 
tifier to a device which utilizes It to automatically re- 
trieve information over the network further includes 
the step of supplying the network information iden- 
tifier to a set-top box associated with a television 
set. 

The method of claim 6 wherein the set-top box es- 
tablishes a connection over the network with a serv- 
er which delivers a web page for display on the tel- 
evision set along with a picture portion of the tele- 
vision signal. 

The method of claim 6 or claim 7 wherein the set- 
top box includes a decoder for extracting the net- 
work information identifier from a closed caption 
portion of the television signal. 

The method of any of claims 6 to 8 further including 
the step of displaying the retneved information si- 
multaneously with a picture portion of the television 
signal on the television set using a picture-in-picture 
arrangement. 



Claims 

1 . A method of accessing information over a computer 
network, comprising the steps of: 



10. The method of any of claims 6 to 8 further including 
the step of permitting a viewer to select between 
display of the retrieved information and display of 
the picture portion of the television signal. 
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11. Tho method of any of claims 1 to 5 wherein the step 
of supplying tho network information identifier to a 
device which utilizes it to automatically retrieve in- 
formation over the network further includes the step 

of supplying the network information identifier to a 5 
computer. 

12. The method of claim 1 further including the step of 
displaying the retrieved information on a display 
screen of the computer. 

13. The method of any of the preceding claims further 
including the step of preventing the retrieval and 
display of information corresponding to a particular 
network information identifier if the particular net- '5 
work information identifier has a predetermined 
form. 

14. The method of any of the preceding claims further 
including the steps of storing a plurality of received 20 
network information identifiers, and allowing a view- 
el' to select one or more of the plurality of identifiers 

lor which corresponding retrieved information will 
be displayed in conjunction with the television sig- 
nal. 

15. The method of any of the preceding claims further 
including the step of allowing the viewer to select 
continued display of the retrieved information cor- 
responding to a particular network information iden- 30 

tifier. 

16. The method of any of the preceding claims wherein 
said receiving step comprises receiving a sequence 

of said network information identifiers and said sup- 3i 
plying step comprises supplying said identifiers to 
said device so that the retrieved information is dis- 
played to said viewer in synchronization with said 
related programming. 

4{ 

17. An apparatus for accessing information over a com- 
puter network, comprising means arranged to carry 
out each step of a method as claimed in any of the 
preceding claims. 
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ing television picture is displayed on a television set. 
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